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What Is a 
Cognitive Radio ? 
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What is a Cognitive Radio ? 


arget Networking 
Experience, 
e.g., Metrics 


What you want 
What you see 


Environmental Parameters, e.g., “Dials” 


Channel Quality Signal Quality Network Load Desktop Application 


Allowable 
Device 
Configurations 


lmniaalitie Site Data E What you 
Power ata a A Comnrocs , a : - 
Device Configurations, e.g., “Knobs ae 


T. Collins, A.M. Wyglinski. “Enabling Security in Cognitive Radios and Wireless Spectrum.” MILCOM Tutorial, 2014. 
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What is a Cognitive Radio ? 


¢ Learning algorithm 
— Explore vs. Exploit 


Global minima 
Local minima 


Iteration number 
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CR applications 
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CR applications 


¢- Satcom 


Reinhart, R. C. Using International Space Station For Cognitive System Research And Technology With 
Space-based Reconfigurable Software Defined Radios. 66% International Astronautical Congress, IAC 2015. 
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CR Satcom —- What you tune: PHY layer 


¢ Modulation scheme 
¢ Encoding scheme 

¢ Symbol rate 

¢ Bandwidth 

¢ Carrier frequency 
ADC/DAC resolution 
Antenna 


¢ Transmission power level 
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Multi-Objective Comms 
Performance 


The problem 
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Multi-objective comms performance 


Table 1. Radio parameter adaptation inter-relationship 


Adaptation Goals Consequences Conflicts Constants 
| M min(BER), min(P) | R,P,BER max(R) Ey 

+ M max(f) + R,P,BER min(BER), min(P) &, 

+ R max(R), W const.” t+ W,P min(P), W const.” M, F, 

| R min(P), W const. | W,P max(R), W const.” M, EF, 


“Keeping W constant can be a goal or a conflicting goal while adapting R. 


M —- modulation and encoding schemes 
R - data rate 

BER - bit error rate 

P — transmission power 

W - bandwidth 

Eb -— energy per bit 
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Reinforcement Learning 
The solution 
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Reinforcement Learning 


Communications channel 


Environment Frr---7 


Space 


Ground 
segment segment 
A,=action 
R,= reward 
S,=state 
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Reinforcement Learning 


Threshold 


No reward LN oN reward 


States 1 2 3 4 N 
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Reinforcement Learning 


¢ Satcom Q(S, A) 


Qr41 (Ski Uk) = Qk (Sp, UK) + AnTh41 


Ux =h(sx) —-+  State-action policy 
Sk+1 = G(Sk,Ux) + State-transition function 


Te+1 = P(Sp,Up) ——* Reward function 
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Satcom RL 
performance 
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Fixed exploration probability (<« = 0.5) 
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Variable exploration probability « 
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Time spent at performance levels 


Mission 1: Launch/re-entry 


L__|BF 
Bi Varyinge 
— Standard error 
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Mission 2: Multimedia 


L__|BF 
Hi Varyinge 
— Standard error 
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Normalized time duration 


(b) 
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Time spent at performance levels 


Mission 3: Power saving Mission 4: Normal 
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Time spent at performance levels 


Mission 5: Cooperation 
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